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ABSTRACT 

An instrument was developed for use in evaluating the 
effects of environmental education (EE) programs on young children's 
attitudes. The instrument consists of pairs of drawings; students 
tell which picture in a given pair they like better. In developing 
the instrument, assumptions were made that second- and third-grede 
students have environmental attitudes and that EE programs have a 
potential to influence these attitudes. The instrument was 
administered to 232 students (294 students originally participating 
in the study) using a pretest/posttest design. These students were 
visiting Hidden Villa Ranch, an EE center in Los Altos Hills, 
California. (Directions and answer forms were translated into Spanish 
for classes with a substantial Spanish-speaking population.) Results 
show that: (1) the instrument can be administered to a large group of 
children quickly, easily, and without trained personnel; (*>) the 
instrument has potential for evaluating changes in young children's 
environmental attitudes; (3) the instrument can be standardized for 
use by many EE programs or be customized to assess specific 
attitudes; and (4) age, sex, and prior EE instruction (either in a 
school or at a center) apparently do not adversely bias students' 
test performance. Supporting documentation (including sample pairs of 
drawings) is provided in appendices. (JN) 
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The Development of an Instrument for 
Evaluating the Effects of Environmental Education Programs 
on Young Children's Environmental Attitudes: A Pilot Study 

Program evaluation has been widely recognized as the area which has the 
greatest rpsearch need in environmental education. Kostka (1977) reported 
that nature center staffs "have no way of knowing if their programs and 
facilities cause any- real impact on the visitors' environmental attitudes." 1 
Roth (1960) added, "(environmental education research efforts that relate to 
the empirical documentation of program effectiveness, demonstrates goal 
attainment, concept acquisition, belief and attitude shift, and skill 
acquisitions are urgently needed." 2 

in particular, little research has focused on the environmental attitudes of 
young children 3 Lucko, et al (1982) underscored this shortcoming — their 
survey of 2£4 elementary and secondary programs found that 49.6% reported 
no evaluation, 4Z.O% informal evaluation at best, and only 7.4% formal 
evaluation. 4 

As a naturalist-intern in Vosemite National Park during the summer of 
1984, I recognized this lack of evaluation firsthand. Children between eight 
and ten years of age who visited the Park had the opportunity to participate in 
the Junior Ranger Program. The goal of this program was for children "to 
enjoy, learn about, and appreciate their natural surroundings in the park and 
apply their awareness to areas elsewhere.. While having fun, children 
will hopefully be stimulated to question and further investigate their 
natur&i environment "^ {emphe, added ) Apparently, the program was 
successful, at least when measured in terms of longevity — children have 
become Junior Rangers every summer since the 1930's. However, did the 
program meet its stated objectives? Did children retain the acquired 
awareness gained through the program once they returned home? There is 
presently no formal evaluation which investigates whether the Junior Ranger 
Program has lasting effects. 

Beyond the simple reason that there is a lack of research, it is important to 
evaluate young children's environmental programs in order to fulfill more 
effectively the primary goal of environmental education, which is to develop a 
population that is (1) knowledgeable about the biophysical and SGciocultural 
environments of which man is a part, (2) aware of environmental problems and 
management alternatives of use in solving these problems, and (3) motivated 
to act responsibly in developing diverse environments that ere optimal for 
ouality life." 6 Variables which affect environmental awareness — beliefs, 
attitudes, behaviors, values and knowledge — are ell influe^d at an early 



Chin 
2 



age. LaHart and Barnes (1979)' outlined a conceptual model which explains 
the interaction of these variables. 
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Environmental information is selectively screened by perceptual receptors. 
It then influences the individual cognitively and affectively. Conversely, tne 
individual's attitude and knowledge can affect perception, individuals who 
possess a positive environmental attitude view themselves "as a part of the 
natural world, [they] feel a personal responsibility for environmental problems 
and an awareness of the ramifications of choices in environmental 
decision-making." 8 The individual's processing of the information therefore 
ultimately affects decision-making and hence environmental behaviors. These 
actions allow additional environmental Information to De received. 
Consequently, it is important to evaluate how environmental education 
programs affect young children — these initial effects will inr^;,.e their 
future environmental perceptions and evw'eness. 

Jaus (1982) demonstrated in a group of fifth graders that those who 
received instruction in environmental education possessed significantly mure 
positive attitudes toward the environment than those who did not receive 
information 9 And what happens in younger children? Mitchell and Lunnpoorg 
(1973) investigated the effects of environmental education on first graders' 
values, skills 8nd knowledge.^ A posttest only design was used and 
assessment was done individually and in small groups through interviews or 
specially-designed tests. Their results indicated that environmental 
education affected values and skills positively but not knowledge 

Objectives 

it was my aim to design an instrument which can be used to evaluate the 
effects of environmental education programs on young children's attitudes in 
particular. I decided to focus on attitudes primarily because of the 
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aforementioned importance of attitudes in shaping young children's 
perceptions of the world, and also because there already exists environmental 
knowledge scales for this age group.* 1 

I wanted to develop an instrument which can be administered quickly, 
easily, and without trained personnel, bu". which would still give an indication 
of program effectiveness; in other words, a "quick and dirty" measure of 
attitude change, in addition, I wanted this instrument to be standardized in 
order for it to be used on large groups, and on a variety of young children's 
environmental education programs. For this latter reason, Mitchell and 
Lunneborg's design would be unsuitable. Perusal of the literature showed that 
no other existing environmental attitude scale would be suitable for pre- and 
post-testing young children, specifically second and third graders, which 
would fulfill the objectives just stated. A new evaluation design would have 
to be developed. 

Developing the Design 

In developing this new design, two chief assumptions were made: (1) 
second and third graders have environmental attitudes, and (2) environments! 
education programs have a potential to influence these attitude*. Anecdotal 1 2 
and research evidence support these assumptions. 

In addition, two limitations had to be dealt with (1) a short time frame 
(about three months) in which to complete the study, and (2) the subjects' 
undeveloped perceptual and cognitive capabilities. 

The first limitation ruled out the possibility of using a longitudinal design 
for evaluating lasting effects. Moreover, a design which would measure 
immediate effects of the program on attitudes would better meet my 
objectives of developing a "quick and dirty" measure. A Solomon 4-group 
design would have been ideal but unfortunately, I did not have the luxury of 
being able to assign subjects to the necessary groups. My subjects were 
students who were already scheduled to visit Hidden Villa Ranch, an 
environmental education center in Los Altos Hills, California. I settled on a 
pre-post design with pre-determined experimental groups and assigned control 
groups (more on this later). 

The second limitation was more challenging to overcome Mitchell and 
Lunneborg pointed out the main difficulty when they reported, "[slince the 
children were young and not expert readers, it was decided that the 
conventional paper and pencil tests used with older children and adults would 
be unsuitable." ^ An instrument which did not require reading was necessary. 

The use of drawings came to mind as the most feasible approach. Rejeski 
(19825 had used drawings successfully to investigate the relationship between 
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children's cognitive development and their perception of the environment. 
However, his instrument required content analysis of the students' drawings 
-- a process which demands expertise and therefore would be not meet the 
objectives of this study. 

An alternative to having children draw pictures is having them interpret 
pictures One approach considered was showing a picture to a large group of 
children and asking them to identify what was r ippening in the picture. Given 
the children's limited writing abilities however, this would have required 
interviewing the children in small groups or individually — again, unsuitable 
for this study. 

Another approach would hove been presenting the children with drawings 
which contained environmentally undesirable features and asking the children 
to circle features which they felt were "bad" or did not "belong". This would 
have required rather complex drawings with a number of items for the 
subjects to preceive correctly, making this as much a test of perception as of 
attitude. 

The approach which ultimately gave rise to the instrument used in this 
study was one which tested concept utilization. 15 Fifty plates were shown to 
children Each plate had drawings of a pair of objects. The children were 
asked, "How are these objects alike?" or "How do these objects go together?", 
in order to test their utilization of the concepts of color, shape, homogeneous 
function, relational function, object qualities, etc. 

This approach was modified to test for environmental attitudes. Each plate 
would contain a pair of drawings. The drawings would be similar but would 
have one significant difference, contrasting an environmentally benign event 
or object with an environmentally deleterious one. The children would be 
shown the plates and then asked to circle on a separate form the letter of the 
drawing they liked better, thereby providing an indication of the children's 
environmental attitudes. As part of a pre-post, experimental-control design, 
this instrument would give an indication of an environmental education 
program's effects on the children's environmental attitudes. It would be quick 
and easy to administer without trained personnel to a large number of 
students, and could be standardized in order to be used with different 
environmental education programs. 

Developing trie Instrument 

In developing the instrument, the key question was what kind of drawings 
to use. This obviously depended on what attitudes were to be measured and 
then, whicn ot tnose attitudes could be transposed into clear and simple 
drawings. Additionally, as Kostka suggested, the drawings should assess "a 
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wide range of environmental attitudes, not specifically limited to the 
subjects under discussion during selected programs, it was reasoned that an 
environmental attitude scale of broad scope could be used to tost effects of 
many different kinds of nature center programs . 

With this latter point in mind, a general list of environmental attitudes 
was generated through perusal of the literature and discussion with 
environmental educators at Hidden Villa (see Appendix A). From tnn list, en 
attempt was made to identify specific attitude objects which couid easily be 
expressed through drawings. It was found that some of the attitudes could not 
be expressed in this manner. For instance, illustrating a food web or the rain 
cycle to test appreciation of interconnectedness in nature was too complex a 
concept to capture in drawings which young children would understand. Of 
necessity, the concepts and the drawings had to be simple. What resulted was 
the formulation of pairs of events or things which would present to children a 
dichotomy of antithetical attitude objects. Nineteen such pairs were 
developed which covered a range of environmental attitudes (see Appendix 
B.I). These pairs were transposed into drawings by four artists. It was 
reasoned that as long as both drawings in a pair were drawn by the same 
artist, style changes between pairs would not adversely affect the subjects' 
perceptions of the drawings. 

In retrospect, these pairs were found to fall into three general categories: 
pastoralism vs. urbanism; preservation of nature vs. abuse of nature, and 
appreciation of natural objects vs. appreciation of human-made objects (see 
Appendix B 2). Although the array of drawings may have been simplistic and 
not inclusive of the whole range of environmental attitudes, it was felt that 
the drawings were representative of the kinds of attitudes which could be 
tested for in thi s age group, and were adequate for the purposes of this pilot 
study. 

The drawings were checked for face validity by three experts in 
environmental education: Herb Dengler, instructor of the "Natural History of 
the San Francisco Bay Area" course at Stanford, Rachel Wing, teaching 
assistant for "Public Decision-making Regarding the Human Environment" 
course at Stanford, and Dana Price, former guide at Hidden Villa Ranch. They 
were unanimous in concurring on which drawing was the environmentally 
oemgn one in each and every pair. 

The set of drawings was then tested for readability and appropriateness in 
a trial run. The subjects were four children from Menlo Park, California: a five 
year-uld boy, an eight year-old boy, an eight year-old girl and a nine year-old 
girl. The children were asked to look at each pair of drawings and, on an 
answer form, circle the choice for the picture they liked better. No indication 
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was given os to the purpose of the test. 

None of the children hod ony problems understanding the content of the 
drawings The five year-old boy hod difficulty keeping his place on his 
answer form with the corresponding pair of drawings. However he was 
younger than the second and third graders who were to be tested in the pilot 
study, since the other three children had no problems with the answer form, 
it was decided to keep the form as it was. 

After the children completed the exercise, they were asked what their 
reasons were for picking their answers. In particular, it was necessary to 
determine if the children were picking their choices for the "correct" reason, 
and not because the picture looked better. The children who picked the 
"correct" picture stated valid reasons for doing so. in almost all cases, at 
least one child picked the "wrong" picture — this indicated that the "correct" 
choice in most pairs was not obvious. One oair of pictures, however, was too 
obvious — pair 5. The children exclaimed, "Simple!" upon seeing the choices 
nnd as one child explained, "No one likes to litter." This pair was eliminated 
from the instrument. 

Pair 14 was touched up in response to a remark that one drawing looked 
better In addition, other pairs were eliminated or combined since they had 
subjects similar to those in other pairs. Pairs 10 end 11 were combined, 
using the drawings of the bird in the birdhouse and the bird in the nest. In 
this new pair, the bird "would be free" and would still have o home in. each 
drawing Pair 6 was eliminated in favor of Pair 7 in order to test whether 
children felt comfortable being alone in either setting Pair 12 was 
eliminated in favor of Pair 13 since the latter pair presented a stronger and 
clearer dichotomy — living flowers vs. picked flowers. 

As a consequence of these changes made after the trial run, fifteen pairs 
of drawings remained. Twelve of these pairs were randomly selected to be 
used in the pretest. The order jf the pairs was randomized as was the 
position of the correct response in each pair. 

For the posttest, the order of the twelve pairs was reversed to help 
decrease the chance of a learning effect, in addition, the remaining three 
pairs were added at the end as a possible measure of any learning effect 

As a further control, two sets of pretests were produced — one merely 
being the reverse order of the other. The posttest for each set was the 
reverse of the corresponding pretest, with the three additional pairs 
appended. 

It was determined from the trial run that color was not needed to improve 
the comprehensibility of the drawings AKo, it was decided that 
mimeographing yielded a product of adequate quality so as not to require 



10 



Chin 
7 



photocopying The pairs of drawings were stapled together into a packet (see 
Appendix 0. 

Administering the Instrument 

It was decided that for this pilot study, the Hidden Villa Ranch program 
would serve as the intervention (see Appendix D). Hidden Villa was selected 
because of my familiarity with its program, its proximity to Stanford, and its 
good reputation among educators The intervention consisted of a 
two-and-a-heif hour classroom visit by a Hidden Villa guide followed a week 
later by a full-day visit to the Ranch by the class The classroom exercises 
included slide shows, puppet shows, singing and role-playing which conveyed 
to the children such concepts as: the histo-y of Hidden Villa; its importance 
to the surrounding community; the value of animals and plants, and the 
sources of the food we eat. On the field trips, each class spent half a day on 
the trails and half a day on the farm. Through a number of activities, the 
children were taught to appreciate the value of cooperation end group unity as 
well as the value of being caretakers of the earth. 

Seven classes from four schools were selected as the experimental group 
for this study These classes were already scheduled to visit the Ranch. 
Fortunately, the schools were from different communities representing a 
range of socioeconomic conditions, two second grade classes from a 
middle-to-lower income community in East San Jose, two third grade classes 
from a similar neighborhood in Redwood City; two second grade classes from 
e middle-to-upper middle income neighborhood in Sunnyvale; and a second 
grade class in middle-to-upper income Palo Alto (see Appendix E). 

It was hoped that control groups would come from the seme schools as 
the experimental groups. However, classes from the same grade in a school 
typically go to Hidden Villa together. Control groups therefore were selected 
from schools in the same neighborhood, and presumably, similar 
socioeconomic conditions, as the schools from which the experimental groups 
came The three control groups were from East San Jose, Redwood City and 
Palo Alto (see Appendix E) 

Preliminary errengements with each of the ten classes were made over 
the phone with teachers and administretorc. Most teachers were heppy to 
participate, especially since the study was being done in cooperation with 
Hidden Villa Ranch. Packets of pretests were delivered to the teachers, along 
with answer forms and instructions (see Appendix F). Administration of the 
tests wgs carried out by the teachers in the classroom with no intervention 
by myself, and the tests were desig, 3d to appeer unrelated to any ectuel 
environmentel education activity. Teachers were asked to read stenderdized 
directions eloud tc their classes to ensure consistency For classes with a 
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substantial Spanish-speaking population, directions and answer forms were 
translated into Sponish. As a guarantee against misinterpretation of tne 
content of the pictures, short, "neutral" descriptions of the pictures were 
reed to the children. Posttests were administered in the same manner (see 
Appendix G). Total testing time did not exceed thirty minutes for either the 
pretest or the posttest. 

For the experimental group, the pretests were given one to three days 
before the Hidden Villa staff visit to the classroom, depending on the 
teacher's schedule. Posttests were given in class one to three days after the 
field trip to Hidden Villa Ranch. For the control groups, the tests were given 
ten to fourteen days apart, in the same time period as for the experimental 
group. 

After the pretests were administered, the students were asked to take 
home and return a parent questionnaire (see Appendix H). Teachers were 
asked to complete a questionnaire as well (see Appendix I). 

Results 

294 students participated in the study. Sixty-two of these cases were 
invalid because these students took either thp pretest or posttest only, or 
incorrectly marked their answer forms. Of the remaining 232 valid cases, 
162 were in the experimental group and 70 w?re in the control group. Their 
test results, and information from the teacher and parent questionnaires 
were encoded and then analyzed using the SPSS X computer package on 

Stanford's LOTS facilities (see Appendix J). 

Total change scores were computed in the experimental and control 
groups by taking the difference between the sum of correct answers for the 
twelve pretest questions and the sum of the correct answers for the 
corresponding twelve questions on the posttest. In the experimental group, 
18* showed a negative change, i.e. scored lower on the posttest than on the 
oretest, 20% showed no change; and 62% showed a positive change, in the 
control group, on the other hand, Z0% showed a negative change; 29% showed 
no change, and 41$ showed a positive change. 



Total Change 

Negative 

None 

Positive 



Experimental 

29 ft as) 
32 (2iW 
101 f62.t ) 
162 



Control 

21 fJiW 
20 (29%) 
29 f4IX ) 
70 
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A chi -squared test for independence was performed on a six-celled 
breakdown of total change scores., yielding a X 2 value of 1 1.57 with 5 degrees 
of freedom, and a probability value of less than 0.05. This result indicated 
that the gains made by the experimental group were significantly greater than 
the gains by the control group, and that there indeed was a substantial 
difference in attitudes because of participation in the Hidden Villa program. 



Total Change Experimental Cor.trol 

<-1 29 Off*/ 21 (JO*) 

0 32 (20*) 20 (29$) 

+ 1 33 (20*) 8 (//*) 

+2 29 Off*) 10 (MX) 

+3 17 (to*) 8 Of*) 

-> *4 22 (14* ) 3 (4*) 

162 70 



(see Appendix K for complete breakdown of data). 



Could the apparent difference be due to other factors? To determine this, 
crosstabulations were computed, controlling for gender; age; previous visits 
to Hidden Villa; end additional environmental education in class which was 
independent of the Hidden Villa program. 

Looking at gender, of the 82 males in the experimental group, 53 (65%) did 
better on the posttests than on the pretests. Of the 80 females, 48 (60%) did 
better in the control group only 17 (38%) of 45 males and 12 (48%) of 25 
females improved scores. For both males and females, the experimental 
groups tended to score higher on posttests than on pretests, whereas the 
controls did not, as expected, thereby indicating that test performance was 
apparently independent of gender. 



MALE 

Totol Change 

None or negative 
Positive 

FEMALE 
Totol Change 

None or negative 
Positive 



Experiments 

29 (55*) 
53 (65* ) 
82 

Experimental 

32 (40*) 
48 (60* ) 
80 



Control 

28 (62*) 
17 (Jff* ) 
45 

Control 

13 (52*) 
12 (48*) 
25 
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As for age, 52 (32%) children in the experimental group were 7 years of 
age or younger; 67 (41 X) were 8 years old, and 43 (27%) were 9 or older. In 
the control group, 25 (36%) children were 7 or younger, 28 (405?) were 8 years 
old, and 17 (24$) were 9 or older. In all three age categories, the 
experimental group tended to score higher on the posttest than on the pretest 
As for the control group, one age category had higher scores on the posttest: 
16 of the 25 in the 7 or younger group did better on the posttest. The other 
two oge categories in the control group had lower posttest scores. Although 
there is no obvious explanation for the single unexpected outcome, in general, 
the data seem to support the expected outcome, thereby indicating that age is 
not a factor in test performance. 



SEVEN YEAR-OLDS OR YOUNGER 



Total Change 

None or negative 
Positive 

EIGHT YEAR-OLDS 
Total Change 

None or Negative 
Positive 

NINE YEAR-OLDS OR OLDER 
Total Change 

None or Negative 
Positive 



Experimental 

21 (40X) 
31 (60S J 
52 

Experimental 

27 (4 OX) 
40 ('6 OX ) 
67 

Experimental 

13 (JOX) 
50 {7iW 
43 



Control 

9 (56X) 

16 (72 J J 
25 

Control 

17 (6 IX) 
11 i'39X ) 
28 

Control 

15 (66X) 
2 (I2X ) 
17 



As for the factor of previous visits to Hidden Villa, in the groups which 
did not visit, the results were as expected. Of 120 in the experimental group, 
7 1 (59$) improved while only 29 (41$) of the 70 in the control group 
improved on the posttests Only 42 students hod been to Hidden Villa 
previously, all in the experimental group. These students still had improved 
scores despite having been to Hidden Villa before — 30 (71$) of the 42 
children scored higher on the posttests. indeed, their scores showed even 
more improvement after a second visit (but this result is based on a rather 
small sample). These findings indicate that the previous experience did not 
negatively affect the instrument's ability to detect attitude changes which 
were a result of their current visit. 
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NEVER VISITED HIDDEN VILLA BEFORE 

Total Change Experimental Control 

None or Negative 49 (4 IX) 41 (59X) 

Positive 71 C59X) 29 i'4IX ) 

120 70 

VISITED HIDDEN VILLA BEFORE 

Total Change Experimental Control 

None or Negative 12 (29X) 

Positive 30 ('7 IX ) _z 

42 



Lastly, for groups which did not have environmental education in class 
other than the Hidden Villa program, the result 0 were as expected. 42 (59%) 
of the 71 children in the experimental group had improved scores while only 
1 1 (228) of the 49 in the control group improved. For groups which aid have 
some environmental education before the pretests, the experimental group 
still showed improvement. 59 (65%) of 91 children scored higher on the 
posttests. The control group also showed improvement: 18 (B6%) of 21 
students scored higher on posttests. The drastic improvement in the control 
group can not be accounted for, but the small number in the sample, and their 
being from the same class, may have skewed the outcome somewhat. Also, it 
seems that previous environmental education would have caused both pretest 
and posttest scores in the control group to be inflated. Therefore, the results 
ere not conclusive; it is not clear what effect previous environmental 
education has on the students' test performances. 

NO PREVIOUS ENVIRONMENTAL EDUCATION IN CLASS 
Total Change Experimental Control 

None or Negative 29 (4 IX) 38 (?6X) 

Positive 42 (59X ) 1 1 t'22X ) 

71 49 

PREVIOUS ENVIRONMENTAL EDUCATION IN CLASS 
Total Change Experimental Control 

None or Negative 32 (35X) 3 (MX) 

Positive 59 (65X ) 18 (66$ ) 

91 21 

Individual questions were also examined to determine how students 
responded item-by-item. On pretests, the mean for the 271 valid cases was 
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8.05 (67%) correct out of 12. On posttests, the mean for the 244 valid coses 
was 10.69 (73$) correct out of 15. Pearson correlations were computed for 
each question on the pretest and posttest to determine the strength of the 
relationship between students' performance on individual questions and 
performance on the test overall. Since the correlations were computed 
without differentiating between experimental and control groups, percentage 
of correct responses was also considered in analysis. 

Several items are of note, in pairs 1 and 12, the extremely high 
percentage of correct responses on the pretest in the experimental group may 
have limited the possibilities for improvement on the posttest. In pairs 3 and 
4, the experimental group showed a small negative change in percentage 
correct. In the case of pair 4, the reason may have been, according to one of 
the teachers' 7 , because the children saw cars but no bicycles at Hidden Villa. 
In pair 8, the control group showed a greate^ gsin in percentage correct than 
the experimental group. In the seven other pairs, the experimental groups 
outgained the control groups in percentage correct. 

On the whole, the statistics show a substantial range of strengths in the 
questions' powers to indicate changes in the students' environmental 
attitudes. Evidently, some questions were better than others in their 
sensitivity as c measure of attitude change. 

EXPERIMENTAL CONTROL PEARSON 



TEST ITEM 




(X correct) 


CORRELATION 


Pretest 1 


90$ 


66$ 


30 


Posttest 1 


86$ 


6i$ 


36 


Pretest 2 


66$ 


72$ 


.42 


Posttest 2 


75$ 


5 7$ 


.51 


Pretest 3 


79$ 


75$ 


.40 


Posttest 3 


77$ 


77$ 


.42 


Pretest 4 


66$ 


71$ 


.33 


Posttest 4 


65$ 


73$ 


.22 


Pretest 5 


50$ 


57$ 


.33 


Posttest 5 


72$ 


45$ 


.37 
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Pretest 6 


61* 


671 


.39 


Posttest 6 


76$ 


7Q% 


.36 


Pretest 7 


59$ 


59% 


.47 


Posttest 7 


74% 


66$ 


.41 


Pretest 6 


56% 


52$ 


.40 


Posttest 8 


60% 


60% 


.37 


Pretest 9 


69% 


75% 


.33 


Posttest 9 


72% 


63% 


.33 


Pretest 10 


67% 


67% 


.47 


Posttest 10 


79% 


75% 


.44 


Pretest 1 1 


60% 


56$ 


.43 


Posttest 1 1 


83% 


69$ 


.40 


Pretest 12 


&9% 


66$ 


.34 


Posttest 12 


95% 


88$ 


.36 


Posttest 13 


60% 

w rw 




.30 


Posttest 14 


54$ 


44$ 


.45 


Posttest 15 


83$ 


88$ 


.36 



The statistics show o similar unconformity for the extra questions on the 
posttests: pairs 13, Hand 15. The expected response was little difference 
betwean the percent correct in the two groups — it would be difficult to 
draw any conclusions from this data as to the presence of any learning effect. 
However, the chances of a learning effect are "somewhat diminished because 
the value-oriented nature of such a test should contribute to the difficulty of 
the respondent to perceive correct answers and anticipate the intent of the 
questions." 18 in addition, if there was a learning effect, the control group 
would have shown significantly higher scores on the posttests. Several of the 
individual items did show this but in terms of total change, the control group 
actually scored lower on the posttests than on the pretests. The results do 
not conclusively answer the question of whether there was a learning effect. 
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The data from the parents' questionnaires was not particularly useful 
since only 50 parents responded. 36 (728) of the parents did note that there 
was a behavioral difference at home after their children's visit to Hidden 
Villa, especially in increased conversation about plants and animals, and in 
expressions of the desire to visit Hidden Villa again. This supports the 
opinion that environmental education programs have some impact on young 
children, albeit in this case, it is behavioral and not in attitude. 

Teachers did not note, to the same degree, change of behavior in the 
classroom. Of the six teachers who responded, only two noted any difference, 
though it is probably difficult for teachers to assess differences in a large 
group. With respect to the administration of the instrument, several teachers 
mentioned that some students had difficulty keeping pictures with their 
corresponding places on the answer forms. They suggested that it would be 
easier for students to mark their answers directly in the packets. 

Discussion 

This pilot study tried out a newly developed instrument aimed at 
measuring changes in young children's environmental attitudes. Several 
comments can be made as a result of the trial. These comments apply only to 
the sample under investigation but give some direction for future 
applications of the instrument. 

First, as is often the case in studies of this sort, the degree of control 
does not account for all threats of validity. Working within the constraints 
of proctical reality meant that allowances had to be made for teachers' 
schedules, different styles of education among the Hidden Villa guides, 
weather, and other external factors which could not be easily controlled for. 
To the extent possible, steps were taken to ensure some consistency in the 
administration of the tests through a standard set of written instructions to 
the teachers. It is believed that the tests were administered in a fashion 
which yielded valid results for the purposes of this study. 

it appears that this instrument can be administered to o large group of 
young children easily, quickly and without the assistance of trained 
personnel, in the future, permitting children to write directly in the packets 
would facilitate administration of the tests -- in this way, the instrument 
would more closely meet the goal of being appropriate for the verbal, writing 
and reading skills of this age group. 

The data indicate that age, gender, and previous environmental education 
(either in the form of previous visits to Hidden Villa or orevious classroom 
instruction) apparently do not adversely bias the studerts' test performance. 
Learning effect does not seem to have a significantly confounding effect, 
either. 
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The design of the instrument, however, needs refinement The 
dichotomous nature of the test is problematic in that it allows only for 
"right" or "wrong" responses whereas values and attitudes often fall into 
"gray" zoRes. it is, however, the feature which allows for the ease of 
administration — the beauty of this instrument is in its simplicity, ft needs 
to be emphasized therefore that this instrument is really a quantitative tool 
which gives a general indication of program effects on young children's 
environmental attitudes. This instrument should be augmented and supported 
by using other methods in order to gain a more accurate measure of a 
program's influence on attitudes. 

Another area needing refinement is in the selection of drawings. Several 
drawings were overly simplistic and resulted in a ceiling effect — there was 
not much room for improvement after the pretest. More research needs to be 
done in developing pairs of drawings which ere appropriate and sensitive 
tests of environmental attitudes, both in difficulty and in content More 
generally, the interaction between young children's attitudes and prescribed 
attitude objects (in our case, di swings) needs to be better understood. 

Conclusion 

it has been shown that the use of drawings has some potential for 
evaluating changes in young children's environmental attitudes. The 
instrument developed in this study represents a simple yet effective way to 
assess a program's impact on environmental attitudes. It is quick and easy to 
administer, and does not require technical or expert assistance. Through 
prudent selection of drawings, it can be be a "quick and dirty" measure of a 
range of environmental attitudes. The instrument can be standardized so that 
it is useable by many environmental education programs yet, at the same 
time, it is adaptable, so that "customized" drawings can be added to assess 
specific attitudes. The instrument's utility can be extended through 
follow-up exercises after the posttests — the drawings provide convenient 
starting points for class discussions on environmental values. 

Refinement, repetition, and further refinement of the instrument will no 
doubt add to the strength of the test, it is my hope that this instrument 
offers a tool which will help environmental educators evaluate their 
programs, snd subsequently, improve them 
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1 M (Donna) Kostka, "Nature Center Program Impact," Journal of 
Environmental Education . 8(1), p. 52. 

2 Robert E. Roth, "Conceptual Development and Environmental 
Education," Journal of Environmental Education . 11(0, p. 8. 

3 Robert E. Horvat and Alan M. Voelker, "Using a Llkert Scale to 
Measure 'Environmental Responsibility." Journal of Environmental 
Education. 8(1), p. 37. 

4 Bernard J. Lucko, John F. Disinger and Robert E. Roth, "Evaluation 
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Levels," Journal of Environmental Education . 13(4), p. 7. 

Junior/Senior Rangers (lYosemite National Park]: n.p., n.d.), n.pag. 
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9 Harold H. Jaus, "The Effect of Environmental Education 
Instruction on Children's Attitudes Toward the Environment," Science 
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Environmental Education on First Graders," Journal of Environmental 
Education . 4(4), pp. 34-37. 

* 1 Personal interview with Mary Hallesy (Hidden Villa), n.d. 
12 Hallesy. 

' J Mitchell and Lunneborg, p. 35. 

' * David W. Rejeski, "Children Look at Nature: Environmental 
Perception and Education," Journal of Environmental Education . 13(4), 
pp. 27-40. 

^Telephone interview with Bill Hammerman (San Francisco 
State University), n.d. 
16 Kostka, p. 53. 

57 Note received from Ms. Sisney (A.J. Dorsa School), n.d. 

18 Dean B. Bennett, "Evaluating Environmental Education 
Programs; in Environmental Education: Strate g ies Toward a More 
Livable Future , ed James A. Swan and William B. Stapp (New York. 
John Wiley and Sons, 1974) p. 132. 
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Selected Environmental Attitudes 
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Selected Environmental Attitudes 

• Caretaking of the earth 

• Appreciation of interconnectedness/whole systems 

• Enjoyment of the natural environment in an intellectual and 

aesthetic fashion 

• Environmental trust — competence and security in natural 

environments 

• Stimulus seeking — affinity for adventurous environmental 

settings 

• Desire to learn more about and become more involved in 

environmental matters 

• Personal sense of responsibility about environmental matters 

• Appreciation of natural objects over human-made objects 

• Awareness of humans' role in ecological relationships 

• Awareness of the importance of preserving the natural environment 

• Concern abojt animals and plants 

■ Acceptance of balances as part of the natural code 

• Awareness of consequences of use and abuse of nature 

• Sense of wonder 
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Appendix B.I - Pairs of cttitude objects 
Appendix B 2 - Categorization of pairs 
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Appendix 0.1: Pairs of Attitude Objects 

Pair Number Piste A Plate B 



1 


Street scene 


Pork scene 


2 




Mountainscape 


3 


Couple in a powerboat 


Couple in a canoe 


A 


Family ridinq in a car 


Family riding bicycles 


5 


Papers strewn around a 


Papers in the wastebasket 




wastebasket 




6 


Three people walking 


Three people welkinq 




down a street 


in the woods 


7 


One person walking 


One person walking 




down a street 


in the woods 


8 


Boy caressing a lizard 


Bou holdino a lizard bu 






the tail 


9 


Healthy lunch 


Fast-food lunch 


10 


Bird on a birdhouse 


Bird on a branch 


! 1 


Bird in a cage 


Bird in a nest 


12 


Flowers growing in the 


Flowers in a vase 




ground 




13 


Flowers nrnwinn in thp 


Flnwpr^ nrnwinn in a 

I 1 U IT CI w Ul U TT IIIU III (J 




ground 


flowerpot 


14 


Children leaving trash 


Children carrying away 






trash 


15 


Deer in a zoo 


Deer in the wild 


16 


Boy looking at a web with 


Boy breaking web with a 




a magnifying glass 


stick 


17 


Boy smelling a flower 


Boy picking a flower 


18 


Girl hugging a tree 


Girl chopping down a tree 


19 


Children watching birds 


Children watching birds 




on television 


outdoors 



Appendix B.2: Categorization of pairs 



• 



Category 1 
Category 2 
Category 3 



Patoralism vs. urbanism 
Preservation of nature vs. abuse of nature 
Appreciation of natural objects vs. appreciation of 
human-made objects 



Pair number Cate gory 1 Cate gory 2 Cate gory 3 

1 x 

2 x 

3 x 

4 x 

5 x 

6 x 

7 x 

8 x 

9 x 

10 x 

1 1 x 

12 x 

13 > 

14 x 

15 xx 

16 x 

17 x 

18 x 

19 x 
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APPENDIX C 
Sample pocket of drawings (posttest form) 



• 
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APPENDIX D 
information on the Hidden Villa Program 




Ffftfi* ******* 

M«fy Dmv 

V** \mr S»*9#* 
E*fCut»yt pfftctpn: 




HIDDEN VILLA INC., 26870 Moody ^d. # Los AMos HiHs, California 94022 



It docs not matter whether one interprets the Activities 
of Hidden Villa Inc. as the supplying of a missing element 
in African life or as the reinforcernent of tendencies 
once strong but in danger of being obliterated by 
urbanization and technology. 

Either way f Hidden Villa performs an indispensable function. 
In a time when the health of the earth is too often f orgotien 
or disregarded, it brings to children (and their oa rents an i 
their teachers) the commitment to earth citizenship and 
stewardship. Ih a time of ethnic, cultural, and religious 
discord it gives children the experience of living and 
learning together, in equality and harmony, in the company 
of the good earth. In a time of increasing and dehumanizing 
urbanization, it makes oossihle for hundreds of young people 
each year the experience of putting foot to natural ground, 
learning and accepting the- animals of the wild and the farm, 
and learning sotrcthir.£ of the intricate interpendency uoon 
which hunian life and j-11 other life is built. It restores, 
for however few and however briefly, a degree of wholeness 
:c the adventure c: growing up in Ainerita. 

Through these exoeriences , this sharing, this uncovering 
cf the natural world and the revelation of our obligated 
oar: :n it, Hidden Villa tries to build, sustain, and 
tnhanu a vis i or. cf the comur.itv cf life. 



preamble by Wallace Stegner 
October 19S1 
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THE MISSION OF HIDDEN VILLA 



To preserve for the long- terra future this unique natural resource 
so that it njy continue to be a meeting place for youn* and old 
to connect themselves to a community of caring people and to the 
cycles of tVt earth. 

To preserve Hidden Villa as a natural, historic, educational and 
recreational resource . 

To use the natural setting, the farm, and traditions relating to 
the property to teach humanitarian and environmental values. 

To enable people to gain an awareness of the inter-re latedness of 

all living things and renew the r.ind, body and spirit in a 
non-ursan setting. 

To preserve and protect the open, natural watershed of Adobe Cruel; 
a^ a comparison to the near-^y developed area*. 

To promote understanding and acceotance of diversity in human and 
r.utural conr. unit let to unc^rsc.^re : ie value of the individual. 

1c retrain aware of and open to charring hurun and er.vironnu.-nta ! 
concern.*. . 



Adopted by the Board of Directors 

Scnte<:oer , \ °: I 
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HIDDEN VILLA 30ALS PURPOSE OF KVEP 
TOv' ARDS CHILDREN- 

To create a sense of wonderment and sensorv exploration 

Promote caretaker ethic 

Develop ecological understanding 

-QALS OF STAFF T FAIN IN ~ TO" ARDS INTERNS AND VOLUNTEER 

To create a jense of caring and commjnity among guides an: professional staff. 

To promote an attuuoe of stevardship towards our environment/. 

T- develop an un •- erst and ing of how the natural environment is an integral 
part of our lives . 

YTo encourage a closeness to tha natural environment in order to expand our 
perception ol shl: it arounJ uc; tnlt promotes values, including licestayies 
that see;; hjrmony v.ith nature. 

Sample Jehevioral Objectives: 

1. .'fter the K7 experience the child will oe aole to give a sample ioou chain. 

2. The child will be able to trace a food source at the supermarket back to its 
origin (DI.7T .MALE LUftCK). 

3. Describe why a certain domestic animal is useful. 

4. lemonstrate at HV a feeling of responsibility for themself, their jrouo end the 
environment (E.3. pick up somc.e else's litter; con't #0*. pick wi Idf lowers , 

help someone along the trail in your group, etc. 
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Directory of sample groups 
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Directory of sample groups 

Ex perimental grou ps 

Waller Hays School, Palo Alto, 855-8403 
Principal: Bill Eliot 
Teacher : Kathy Dills 26 students 
Pre-test given: Feb 1 1th 
Classroom visit: Feb 12th 
HV visit: Feb 20th 
Post-test given: Feb 25th 

Cherry Chase School, Sunnyvale, (408)736- 11 53 
Principal: Robert Kessler 
Teachers: Ms. Ranada 33 students 
Ms. Clark 31 students 
Pre-test given: Feb 13th 
Classroom visit: Feb 15th 
HV visit. Feb 26th 
Post-test given. March 4th 

A.J.Dorsa School, East San Jose, (408)259-2460 
Teachers: Ms. How 30 students 
Ms. Sisney 30 students 
Pre-ter* given: Feb 18th 
Classroom visit: Feb 20th 
HV visit: Feb 27th 
Post-test given: March 1st 

Hoover School, Redwood City, 366-8415 
Principal; Mike Fernandez 
Tf ^chers: Ms. Hodge 29 students 
Ms. Kruse 31 students 
Pre-test given: Feb 21st 
Classroom visit: Feb 22nd 
HV visit. March 1st 
Post-test given: March 5th 
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Control g roups 



Toft School, Redwood City, 369-2569 
Resource teacher. Bob Mantia 
Teacher: Marion Sturgeon 25 students 
Pre-test. Feb 21st 
Post-test: March 5th 

Sloanaker School, East San Jose, (408) 259-1940 
Principal: Bob Bird 

Teacher. Mary Austin 32 students 
Pre-test: Feb 15th 
Post-test: March 1st 



Escondido School 

Teacher: Barbara Richardson 27 students 
Pre-test: Feb 26th 
Post-test: March 1 1th 



APPENDIX F 
Pretest directions (experimental group) 
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P.O.Box 10515 
Stanford CA 94305 
19 February 1965 

Dear Ms. 

First let me thank you and your class for agreeing to participate in this 
study. I hope the results can be used to help improve the environmental 
education curriculum in our schools. 

To review our telephone conversation the purpose of this study is to 
evaluate whether a field trip to Hidden Villa Ranch has a significant 
impact on young children's environmental attitudes. With your help, i am 
asking your students to look at twelve pairs of drawings and to indicate 
for each pair which drawing they like better. This exercise will be carried 
out twice : once as a pre-test before the Hidden Villa presentation in the 
classroom, and once as a post-test after the class visit to the Ranch. Each 
test should take no more than twenty minutes to administer. Details on the 
post-test will be given to you on the day of your visit to Hidden Villa. The 
rest of this letter gives directions for administering the pre-test. Please 
follow these directions as closely as possible to ensure a high degree of 
control. However, please feel free to assis students who need help, 
especially if there are students who do not understand English well. 

As we agreed, the pre-test will be adminstered in class before the Hidden 
Villa staff visit to the class on Feb. 22nd. Enclosed you will find a booklet 
for each student in your class plus a booklet for yourself. Please do as 

fOllOWS: 

1) Introduce the exercise; "We are now going to do an exercise 
with pictures/ CAhera hacemos un ejercicio con ditujos. V 

2) Pass out the booklets, one per student. 

3) Say "Please follow mg directions carefully... Tear off the 

' top sheet of the booklet. This is your answer sheet. Please mark 
your answers to my questions on this sheet only. Do not write in 
the booklet." (For favor, escuchen mis intrucciones con cuidado. 
Qui ten la primers pagina del liorete. Esto es tu pagina de 
respuestas. favor de escrioir tus respuestas solamente en est a 
pagina. No escrioan en el Horete. V Please indicate to the students 
that they may use either the English or Spanish side of the form. 

4) Say "Now please fill in your name and age at the top of 
the answer sheet, and check off whether you are mole or 
female." CAhora, escritfa stt nombre y tu edad en /a caneza de /a 



pogino, y morco si ores n/ifo o nine. V 

5) Say 'We ore going to look ot two pictures on eoch page in 
the booklet. 1 want you to choose which picture you like better. 
Then for eoch page, I want you to circle your choice on the 
answer sheet. There are no right answers. Just choose the 
picture you like better." (Vomts o miror dos dibujos en code 
pogino en el librete. Vomos e escoger cuol dibujo te gust 6 mos. 
Entonces poro code pogino, morco tu seleccidn en tu pope} de 
respuestos. No hey respuestos correct es. Solemente escoge el 
dibujo que te prefieres mos. V 

6) Say "Now look at the pictures on page one... Which picture 
do you like better?... Please circle your answer on the answer 
sheet." CAnoro, miren los dibujos en la peg i no uno... Quo! dibujo 
te prefieres mos? Fovor de morcor tu respttesto en lo pogino de 

; espuestos. ") Please check to see if the students are doing this 
correctly. When they have done this, tell the student: "Please turn to 
the next page." (Tor fovor, continuomos o lo proximo pogino. V 

7) If students have difficulty identifying the content of the pictures, 
use the following descriptions . 

Page 1: These are pictures of a boy and a flower. 

(1st os dibujos son de un nine y uno flor.J 
Page 2: These are pictures of a boy and a lizard. 

(Sst os dibujos son de un nine y un logorto.) 
Page 3: These are pictures of a boy and a spider web. 

(Est os dibujos son de un nine y uno te lor one J N 
Page 4. The^e are pictures of a family in the country. 

(Est os dibujos son de uno fomilio en el compo ) 
Page 5; These are pictures of a boy on a walk. 

(Est os dibujos son de un nine en comino. ) 
Page 6: These are pictures of children watching birds, 

(Est os dibujos son de oigunos nines que 
observon los pojoros. ) 

Page 7: These are pictures of children after o picnic. 

(Est os dioujos son de oigunos nines de spues de un 

picnic. ) 

Page 8. These are pictures of lunches. 

(Est os dibujos son de oigunos olmuerzos.) 
Page 9: These ere pictures of neighborhoods. 

(Est os dtbujos son de oigunos vecinidedes } 
Page 10: These are pictures of a town and of the country. 

(Est os dibujos son de un pueblo y el compo. ) 
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Poge 1 1: These ore pictures of flowers. 

if ftps? dibujos son de ones f fares ) 
Page 12: These ore pictures Of deer. 

(Est as dibujos son de un venedo.) 

6) Soy "This should he poge two" CEste dene ser Id peg f no 

dos. V. if students hove trouble finding it, pleese help them out. When oil 
the students ore on poge two, tell them "Look at the pictures on page 
two." (Vemos e observer Jos dibujos en /e peg f no dos. VGo bock to 
*6 ond continue administering the test in the some manner, using the 
oppropriote page numbers (and the appropriate descriptions if necessory). 

Z) After page 12, collect the answer sheets separately from the 
booklets. Do not discuss the answers or the test since there will be o 
post-test using the some drawings. 

10) Please note on a piece of paper if there werp any problems in 
administering this test, whether in the directions, in the content of 
specific drawings or in^ny other aspect of this exercise. 

1 1) Have the booklets and the answer sheets ready for pick-up in the 
mam office 

If ony of the directions ore unclear, please feel free to contact me (or 
leave a message) at (415)853-9674 (afternoons, early evenings ore best). 

Once again, thank you very much for your cooperation. I will be in touch 
about the post-test. I look forword to receiving these pre-tests. 

Sincerely, 
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APPENDIX G 
Posttest directions (experimental group) 
Answer forms (front and back) 
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P.O.Box 10515 
Stanford CA 94305 
26 February 1985 

Dear Ms. 

I hope you and your class enjoyed your visit to Hidden Villa. This letter 
gives directions for administering the post-test. If at all possible, it 
should be given two school days after your visit to Hidden Villa (around 
March 5th). The test is exactly the same as the pre-test except that the 
order is reversed and three additional pages have been added, it should 
take approximately the seme amount of time to administer. Agoin, please 
follow these directions as closely as possible to ensure a high degree of 
control. However, please feel free to assist student who need help, 
especially if there are students who do not undersiemd English well 

Enclosed you will find a booklet for each student in your class plus a 
booklet for yourself. Please do as follows: 

1) Introduce the exercise: "We ore now going to do on exercise 
with pictures." ("A hero hocemos un ejercicio con dittujas. V 

2) Pass out the booklets, one per student. 

3) Say "Pleose follow my directions corefully... Tear off the 
top sheet of the booklet. This is your answer sheet. Pleose mork 
your answers to my questions on this sheet only. Do not write in 
the booklet." (For favor, escuchen mis intrucciones con cuidodo. 
Qui ten /o primero pSgino del /ibrets. Esto es tu pogino do 
respuestos. Fovor do escribir tus respuestos so) omen to en esto 
pogino. No e^tribon en el Jibrete. V Plense indicate to the students 
that theu may use either the English or Spanish side of the form. 

4) Say "Now pleose fill in your name and age at the top of 
the answer sheet, and check off whether you ore male or 
female." CAboro, escribe tu nombre y tu edod en to cobezo do is 
pogino, y morco si ores nino o nino. ) 

5) Say "We are going to look at two pictures on each page in 
the booklet. I want you to choose which picture you like better. 
Then for each page, I want you to circle your choice on the 
answer sheet. There arc no right answers. Just choose the 
picture you like better." (Vomos o miror dos dibujos en codo 
pogino en el librete. Vomos o escoger cuof dibuje te gusto mos 
Entonces poro codo pogino, morco tu se/ecc/cn en tu pope/ de 
respuestos. No hoy' respuestos correctos. SoJomente escoge e) 
dibujo que te pre fi eras mos. V 
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6) Say 'Now look at the pictures on page one... Which picture 
do you like better? ... Please circle your answer on the answer 
sheet." ("A/tore, miren /as dibujas en le peg i no une... Quo/ dibit jo 
te prefieres mes? Fever efe mercer tu respites te ert fe peg fete de 
respites tes. V Please check to see if the students ore doing this 
correctly. When they have done this, tell the students "Please turn to 
the next page." ("Per fever, centinuemes e /e proximo pegino ") 

7) If students have difficulty identifying the content of the pictures, 
use the following descriptions : 

Page 1. These are pictures of deer. 

(Fstes dibit jes sett de urt venedo.) 
Page 2: These ere pictures of flowers. 

(Fstes dibit] es sen de unes flares.) 
Page 3: These are pictures of a town and of the country. 

(Fstes dibit/ a s sen de un pueblo y el cempo. ) 
Page A. These ere pictures of neighborhoods. 

(Fstes dibujes sen de e/gunes vecinidedes ) 
Page 5: These are pictures of lunches. 

(Fstes dibujes sen de e/gunos e/mtterzas. ) 
Page 6; These are pictures of children after a picnic. 

(Fstes dibujes sen de e/gunos nines despite s de un 

picnic. ) 

Page 7: These are pictures of children watching birds. 

(Fstes dibujes sen de e/gunos nines due 
ebs erven /es pejeres. ) 

Page 8: These are pictures of a boy on a walk. 

(Fstes dibujes son de un nine en cemino.) 
Page 9: These are pictures of a family in the country. 

(Fstes dibujes son de une femi/ie en el cempo.) 
Page 10; These are pictures of a boy and a spider web. 

(Fstes dibujes sen de un nfne y une te/erene. ) 
Page 1 1; These are pictures of a boy and a lizard. 

(Fstes dibujes son de un nine y un I eg ert a.) 
Page 12: These are pictures of a boy and a flower. 

(Fstes dibujes son de un nine y une flor.) 
Page 13: These are pictures of a bird. 

(Fstes dibujes sen de un pojero.) 
Page 14 These are pictures of two people in a boat. 

(Fstes dibujes sen de das persenes en un bote.) 
Page 15 These are pictures of a girl and a tree. 

(Fstes dibujes sen de une nine y un orb of.) 
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6) Say "This should be page two" ("fste dePe ser /e pegine 
do&J). If students hove trouble finding it, pleose help them out. When all 
the students ore on page two, tell them "Look fit the pictures on page 
two." (Vemos e observer /as dibujas en /e peg/ne das. VGo back to 
*6 and continue administering the test in the some manner, using the 
appropriate page numbers (and the appropriate descriptions if necessary). 

9) After page 15, collect the answer sheets separately from the 
booklets. 

10) Pass out the parent questionnaires to the students. Tell the 
students "Pleose take these forms home to your parents. They ore 
to complete them for you to return to school in two days." (Par 
fey or Devon estes pepe/es o fus coses y fas den e sus pedres. 
En fences, les pi den pere comp/eterfcs en das dies pere que 
ustedes pueden deva/ver/as e /e c/ese.J Enclosed please find stickers 
to be given to the students when they return the questionnaire from home. 

1 1) Please fill out the teacher questionnaire. 

12) Have the booklets, the answer sheets, the parent questionnaires 
and the teacher questionnaire ready for pick-up in the main office three 
days after the post-test is given (around March 6th). 

If any of the directions are unclear, please feel free to contact me (or 
leave a message) at (415)653-9674 (afternoons, early evenings are best). 

Once again, thank you very much for your cooperation. 

Sincerely, 
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PICTURE EXERCISE 



Nome 



Age. 



(check one) Mole Femole. 



Pleese circle your answer. 



On poge 1: 
On poge 2 
On poge 3: 
On poge A. 
On poge 5. 
On poge 6. 
On poge 7: 
On poge 8: 
On poge 9: 
On poge 10. 
On poge 1 1: 
On poge 12: 
On poge 13. 
On poge 14: 
On poge 15, 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture A better 



like Picture B better 



like Picture 8 better 



like Picture B better 



like Picture B better 



like Picture B better 



like Picture B better 



like Picture B better 



like Picture B better 



like Picture & better 



like Picture B better 



like Picture B better 



like Picture B better 



like Picture B better 



like Picture B better 



like Picture B better 
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EJERCtCIO DE PIBUJQ 



Me Homo 



Tengo 



anos. 



Soy nino nine (Favor de circuit) 



Favor de circular tu respuesta. 



En 



En 



En 



En 



En 



En 



En 



En 



En 



En 



En 



En 



En 



En 



En 



a pagina I: fie guste el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 2: Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 3: Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 4. Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 5: Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 6: Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 7. Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

e pagina B: Me guste el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 9: Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 10: Me gusta el dibujo A mejor. Me gusta e! dibujo B mejor. 

a pagina 11: Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 12: Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 13. Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 14: Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 

a pagina 15: Me gusta el dibujo A mejor. Me gusta el dibujo B mejor. 
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Dear parent or guardian; 

Vour child recently participated in the Hidden Villa Environmental Program 
on a class field trip. We hope he or she enjoyed the visit to our roncjt 
In order for Hidden Villa to serve future classes better, we would like you 
to answer these questions &r.d to add your comments. This questionnaire 
may he completed by either parent or a guardian. Please return this 
questionnaire to your child's teacher in the next two days! Thank/you for 
yoc r cooperation. / / 

Your name 

Child's name 

Do you have any other children? If yes, what are their ages? , 



What is the highest level of formal schooling you have completed? (Please 
circle one). 

Elementary 1 2 3 4 5 6 7 8 

High School 9 10 11 12 

College 12 3 4 

Postgraduate 12 3 4 5 

Have you taken your child(ren) on any outdoors or environmental 
experiences, such as camping, hiking or a visit to a natural history 
museum? 



What, if any, differences have you noticed in your child after his or her 
visit to Hidden Villa (for example, more discussion about the environment 
or greater tendency to pick up trash)? 



/ 

/ 

/' 

Additional comments; Please use separate sheet of paper end attach. 



Estimedos Padres o Custodio: 

Su hi jo o hi jo recientemente participo en el Hidden Villa Environmental 
Program en un viaje que hizo su clase escoler. Esperamos que le gusto la 
visile a nuestro rancho De manera que Hidden Villa puede servir otras 
clases escolares mejor, le pedimos que contesten estas preguntas y que 
agregen sus comentarios. Este cuestionerio puede ser completado por uno 
de los dos padres o por el custodio. Favor de devulver e c te cuestionario el 
maestro de su hi j o dentro de los dos proximos dias. Gracies por su 
cooperecion 

Su nombre 

El nombre de su hi jo 

cTiene Ud otros hijos? iSi contesto si, cuaies son sus edades? 



cCub) es el nivel de escolenze mas elte que Ud. he completado? (Favor de 
circular uno) 

Elementario 1 2 3 4 5 6 7 8 

Segundaria 9 10 11 12 

Universitarie 12 3 4 

Post Graduado 12 3 4 5 

cHq elevado Ud. a sus hijos en algun vioje de netureleze tales como 
camping, caminatas o una visita a un museo de historia natural? 



tQuc diferencies, si algunas, he notedo Ud. despues que su hi jo o hija 
visito Hidden Villa (por ejemplo, su hijo o hija ha tenido mas 
conversasiones sobre la nature!e2a o mas tendencies hacia a necojer 
basure)? 



Comentarios adicioneles: Favor de usar una hojo de papel separeda y tachar 
a esta hoja. 



78 



# 



APPENDIX I 
Teacher Questionnaire 
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Teacher Questionnaire 

Please answer these questions in order to improve analysis of the student 
test results. Thanks for your cooperation. 

School: 

Teeche*- 

Number of students: 

Date pre-test given 

Date post-test given:__ 

Has the class been to Hidden Villa before? Yes No 

Was there any difficulty in administering the pre-test? the post-test? 



What, if any, noticeable differences are there in the students as a result 
of their visit to Hidden Villa (for example, more discussion about the 
outdoors or the environment, less packaging in lunches, greater tendency 
to pick up trash)? 



Was there any instruction in environmental education before the testing 
period? during the testing period? If yes, what topics were taught? 



Compared to previous classes, would you characterize this class as more, 
less or equally aware of environmental issues? 
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APPENDIX J 
SPSS X program 
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Complete breakdown of total change scores 
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Complete Breakdown of Total Change Scores 
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